Nonlinear thermodynamic quantum master equation: Properties and examples 
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The quantum master equation obtained from two different thermodynamic arguments is seriously 
nonlinear. We argue that, for quantum systems, nonlinearity occurs naturally in the step from 
reversible to irreversible equations and we analyze the nature and consequences of the nonlinear 
contribution. The thermodynamic nonlinearity naturally leads to canonical equilibrium solutions 
and extends the range of validity to lower temperatures. We discuss the Markovian character of 
the thermodynamic quantum master equation and introduce a solution strategy based on coupled 
evolution equations for the eigenstates and eigenvalues of the density matrix. The general ideas 
are illustrated for the two-level system and for the damped harmonic oscillator. Several conceptual 
implications of the nonlinearity of the thermodynamic quantum master equation are pointed out, 
including the absence of a Heisenberg picture and the resulting difficulties with defining multi-time 
correlations. 

PACS numbers: 05.70.Ln, 03.65.Yz 



I. INTRODUCTION 



Quantum master equations provide a useful tool for 
describing dissipative quantum systems (T], [|[ . Most pop- 
ular are the linear master equations of the Lindblad form 
Q. However, it has been known for some 30 years 
that these equations have a fundamental problem be- 
cause they invoke an incorrect "quantum regression hy- 
pothesis" [4-6]. For quantum systems in contact with 
a heat bath, this problem has been overcome by in- 
troducing a nonlinear master equation associated with 
a "modified quantum regression hypothesis" [4|. This 
modified master equation has been obtained by means of 
the projection-operator method. The resulting nonlinear 
master equation is not limited to high temperatures for 
which quantum effects are unavoidably small. It has ac- 
tually been shown that the quantum master equation can 
be applied down to arbitrarily low temperatures provided 
that the frictional coupling to the heat bath becomes suf- 
ficiently weak [7J. Once the thermodynamically consis- 
tent nonlinear master equation has been formulated, one 
can look for special situations in which exact or approx- 
imate linear master equations can be derived. This has 
been done in Q, with the conclusion that the resulting 
master equations are not of the popular Lindblad form. 

The formulation of a nonlinear master equation in [4| 
was triggered by a problem with the "quantum regres- 
sion hypothesis," that is, by a thermodynamic argument. 
The field of quantum dissipation has recently been ap- 
proached from an entirely different perspective, which 
is also rooted in thermodynamics and leads to a more 
general nonlinear quantum master equation Q . Starting 
from a modern geometric formulation of nonequilibrium 
thermodynamics for classical systems [10l - [l2| . Dirac's 
method of classical analogy (see Chapter IV of [l3j|) has 
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been employed for a generalization to quantum systems. 
For reversible systems, the recognition of the deep corre- 
spondence between classical Poisson brackets and quan- 
tum commutators is the key to establishing the quantum- 
classical correspondence. Poisson brackets provide one of 
the important structures used in nonequilibrium thermo- 
dynamics, namely to formulate reversible dynamics. Ir- 
reversible dynamics is formulated in terms of dissipative 
brackets, for which a quantum generalization in terms of 
canonical correlations has been proposed in The re- 
sulting evolution equations may be considered as a gener- 
alization of the nonlinear quantum master equation pro- 
posed in rather than being restricted to heat baths, 
the formulation of Q is applicable to arbitrary thermo- 
dynamic environments, including time-dependent ones, 
where also the influence of the quantum subsystem on 
the evolution of the classical environment is predicted. 

Whereas linearity seems natural in a quantum mechan- 
ical setting, it should not be taken for granted in ther- 
modynamics. This is a consequence of the appearance 
of entropy, which typically involves logarithmic terms. 
Going beyond reversibility in general requires to go be- 
yond linearity. For classical systems, there occurs a fortu- 
itous cancelation that leads to the linearity of the Fokker- 
Planck equation (on the level of distribution functions /, 
the key identity is fd(6Sf/6f) = — k^fdlnf = — kndf, 
where Sf is the entropy and &b is Boltzmann's constant; 
see Section III.B of [To| ) ■ The noncommutativity of quan- 
tum observables prevents such a cancelation. As thermo- 
dynamics is the language for formulating healthy equa- 
tions with well-behaved solutions, the nonlinearity, which 
we have recognized as a quantum effect required by the 
principles of thermodynamics, should not at all be con- 
sidered as a drawback. The purpose of the present paper 
is to elaborate the advantages of the nonlinear thermo- 
dynamic master equation originally proposed in Q and 
recently recovered as a special case of [9( for a heat bath 
in a detailed comparison with the popular linear mas- 
ter equation. We consider the two-level system and the 
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FIG. 1: Different couplings between quantum mechanical sys- 
tems (QMS), classical mechanical systems (CMS), and classi- 
cal thermodynamic systems (CTS); continuous lines between 
systems indicate a reversible coupling, whereas dashed lines 
represent an irreversible coupling. 



damped quantum harmonic oscillator as concrete exam- 
ples. 

We first summarize the equations obtained from ther- 
modynamics for quantum systems interacting with a clas- 
sical environment and discuss some of their key features, 
most importantly, nonlinearity (Sec. [TTJ) . After a short 
description of possible solution strategies for the non- 
linear master equations resulting from thermodynamics 
(Sec. IIIII) . we study the examples of the relaxation be- 
havior of the two-level system (Sec. HV|) and the damped 
harmonic oscillator (Sec.|Vj in detail. We end with a brief 
summary and offer some concluding remarks (Sec. IVI[) . 



II. THERMODYNAMIC APPROACH TO 
QUANTUM DISSIPATION 

As a first step, we discuss different motivations for con- 
sidering quantum-classical systems. We then discuss the 
"quantum regression hypothesis" and compile the essen- 
tial results of the thermodynamic approach to quantum 
dissipation. In particular, we give the evolution equa- 
tions for the quantum subsystem and its environment, 
and we discuss some basic features of these equations. 



A. Quantum-classical systems 

There exist different reasons for coupling quantum and 
classical systems. We begin with the discussion of the two 
extremes illustrated in the bottom and top of Fig. Q] (i) 
The reversible coupling of a quantum system to classi- 
cal phase space ("atomistic") variables, and (ii) the irre- 
versible coupling of a quantum system to a classical ther- 
modynamic system, usually a heat bath. The motivation 
behind the approach (i) is to make "atomistic" simula- 
tions feasible by treating some of their degrees of freedom 
classically, typically because they are associated with the 
heavier particles in the system. The combined system (i) 
is described by a purely reversible quantum- classical Li- 
ouville equation (see, for example, Eq. (6) of [Hj]). The 



approach (ii) is based on the elimination of degrees of 
freedom from the environment, which typically requires 
a weak coupling so that the quantum subsystem feels 
the influence of the environment only on long time scales 
and rapidly fluctuating variables can hence be eliminated 
from the environment. Of course, some kind of approxi- 
mation or limit is always needed to justify the treatment 
of certain degrees of freedom by classical mechanics or 
thermodynamics. Typical applications are quantum rate 
processes (such as proton or electron transport) depend- 
ing on the presence of characteristic groups of atoms for 

(i) , and nuclear spin relaxation in a surrounding medium 
for (ii). 

Quantum-classical Liouville equations are usually sim- 
plified by means of the momentum-jump approxima- 
tion for nonadiabatic transitions and the corresponding 
changes of the bath momentum 14j . For the proper de- 
scription of decoherence, it is necessary to include fur- 
ther classical degrees of freedom which typically serve 
as a heat bath for the classical atoms as illustrated in 
the middle of Fig. [1] One then arrives at the dissi- 
pative quantum- classical Liouville equation involving a 
Fokker-Planck-like operator (see, for example, Eq. (15) 
of [HI )• The irreversible coupling between the two classi- 
cal subsystems may contain an additional reversible con- 
tribution, such as an effective force. As an alternative 
to the dissipative quantum-classical Liouville equation, 
a Markovian quantum-classical master equation for the 
three coupled systems in the middle of Fig.Q]has been de- 
rived on the full phase space, including a typical molecule 
of a heat bath as the classical thermodynamic system (see 
Eq. (27) of 115] and Eq. (20) of QJ]). 

In the present work, we are interested in the approach 

(ii) , that is, in the irreversible coupling of a quantum sys- 
tem to a classical thermodynamic environment. As dis- 
cussed in the introduction, thermodynamic consistency 
arguments have been discussed and implemented in the 
context of the quantum master equation. Also for other 
approaches to dissipative quantum systems, such as oper- 
ator Langevin equations, stochastic dynamics in Hilbert 
space, or path integrals fl!.I^ IT7l - fl9l |. thermodynamic con- 
sistency should be established. 

The nonlinear thermodynamic master equation of @ 
describes a quantum system interacting with a classical 
thermodynamic system where, in general, the classical 
environment is a nonequilibrium system with its own 
thermodynamic evolution that has to be determined to- 
gether with the evolution of the quantum system. The 
coupling between the quantum subsystem and its classi- 
cal environment is entirely of the irreversible type; the 
postulated Markovian description implies restrictions on 
the separation of time scales and the weakness of the 
interaction [7J . For the special case of an equilibrium en- 
vironment, that is, a heat bath with a fixed temperature, 
the nonlinear thermodynamic master equation has been 
derived already 30 years ago by means of the projection- 
operator method [J]. As thermodynamically consistent 
master equations have hardly ever been used in the lit- 
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erature, our goal is to consider the properties of these 
nonlinear master equations in some detail. 



B. Quantum regression hypothesis 

Quantum master equations for the evolution of the 
density matrix or statistical operator p on a suitable 
Hilbert space are usually assumed to be of the linear 
form 0,3, 



where £ is a suitable super-operator, say of the Lind- 
blad form [3j. According to the Schrodinger picture, the 
time-dependent density matrix p can be used to calculate 
the evolving average (A) = tr (Ap) of an observable that 
is represented by a time-independent self-adjoint opera- 
tor A. The next goal is to calculate multi-time correla- 
tion functions. In order to do so, one usually switches 
to the Heisenberg picture based on evolving observables 
to be averaged with a time-independent density matrix. 
When two-time correlations are evaluated by means of 
the Heisenberg picture, one finds that the decay of two- 
time correlations is governed by exactly the same evolu- 
tion equation as the decay of averages, which is known as 
the "quantum regression hypothesis" (see, for example, 
Section 3.2.4 of [l|). More precisely, we have for example 
the following two-time correlation of two observables A 
and B, 

({A(t),B}) p =tr(Ae- ia [B,p\), (2) 

which nicely shows the occurrence of the evolution super- 
operator in this expression for two-time correlations. 

An alternative possibility to calculate two-time corre- 
lations is based on the fluctuation-dissipation theorem of 
the first kind (see Eq. (4.2.18) of 20] or Eqs. (6.7), (6.11), 
and (6.14) of H), 

([A(t),B]) p = -±-tr(Ae- iCt CB p ), (3) 

where h and fee are Planck's constant divided by 27r and 
Boltzmann's constant, respectively, and T c is the tem- 
perature parameter of the canonical density matrix p 
assumed in Eq. ([3]). For given operator A and density 
matrix p, the operator A p is basically the product of A 
and p, but with a compromise between placing p to the 
left or the right of A, 

A p = f p x Ap x - x d\. (4) 
Jo 

If A is self-adjoint, this property is inherited by A p . Note 
that A p has the useful property 

[A,p] = [A p ,]xxp], (5) 



which follows from looking at arbitrary matrix elements 
formed with the eigenstates of the density matrix and 
performing the elementary integration over A in Eq. (j4|) . 

The fluctuation-dissipation theorem can be derived by 
multiplying Eq. (|5|) with another observable and taking 
the trace, 

([A,B]) p = tv(A[B p Mp]). (6) 

If p is a canonical density matrix, H = — fceTelnp 
describes the Hamiltonian time evolution, and A is 
the Heisenberg operator A(t), then Eq. ((6|) yields the 
fluctuation-dissipation theorem ([3]). If the operator iden- 
tity (O is used in Eq. (|2|) one realizes that the "quantum 
regression hypothesis" can only be consistent with the 
fluctuation-dissipation theorem © if £ is of the Hamil- 
tonian form, but not for dissipative master equations. 
This observation is the well known failure of the "quan- 
tum regression hypothesis." 

This failure of the "quantum regression hypothesis" 
and the nonlinear dependence of B p on p in Eq. ([3]) moti- 
vated Grabert to revisit the standard projection-operator 
derivation of quantum master equations [21] with a rel- 
evant density matrix of the exponential form, where the 
deviation from the Hamiltonian in the exponent can be 
interpreted as the thermodynamic force operator conju- 
gate to the density matrix. In the Markovian limit, the 
resulting equation is of the nonlinear form (see Eq. (5.22) 
of 1), 

f = 1 [P > H] ~ k^k [0 ' [0 ' H]p] M [Q ' [Q ' P]] ' (7) 

with a suitable parameter M describing the strength of 
the dissipation and an observable Q describing the inter- 
action between the quantum subsystem and its quantum 
environment. Note that the temperature T c is the only 
parameter characterizing the state of the environment, 
which hence acts as a heat bath. The strength of the dis- 
sipative interaction between the subsystem and its envi- 
ronment is characterized by the parameter M. Equation 
([7]) may be addressed as a thermodynamic master equa- 
tion because it has been derived with a relevant density 
matrix characterized in terms of a thermodynamic force 
operator and because, as a consequence, it is consistent 
with the fluctuation-dissipation theorem. 

C. Thermodynamic quantum master equation 

The thermodynamic quantum master equation ([7]) 
holds for an environment acting as a heat bath. This 
nonlinear master equation can be generalized to more 
complicated classical nonequilibrium systems as environ- 
ments. Based on purely thermodynamic considerations 
and a generalization from classical to quantum systems 
inspired by a geometric formulation of nonequilibrium 
thermodynamics, the following master equation for the 
evolution of the density matrix or statistical operator p 
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has been proposed to characterize a quantum subsystem 
in contact with an arbitrary classical nonequilibrium sys- 
tem acting as its environment: 

d i t =\\P^\ -^[H e ,S e ]Q[Q,[Q,H] p ] 

- [H e ,H e ]Q[Q,[Q,p]). (8) 

The first term describes the reversible contribution to the 
evolution generated by the Hamiltonian H via the com- 
mutator. All other terms are of irreversible nature and 
result from a coupling of the quantum subsystem to its 
environment. They are expressed through double com- 
mutators involving the self-adjoint coupling operator Q 
so that the normalization condition, tr p = 1, is auto- 
matically preserved in time. As a consequence of the 
occurrence of commutators with the coupling operator 
Q, the evolution of the average (Q) p performed with the 
time-dependent density matrix p is not explicitly affected 
by the dissipative terms. 

Whereas the type of the coupling is given by the ob- 
servable Q, the strength of the coupling is expressed in 
a dissipative bracket [ , ] defined as a binary operation 
on the space of observables for the classical environment 
(throughout this work, boldface bracket symbols are used 
to distinguish classical dissipative and Poisson brackets 
from quantum commutators and anticommutators, re- 
spectively). If the equilibrium or nonequilibrium states 
of the environment are characterized by state variables x, 
classical observables are functions or functionals of x, and 
their evaluation at a particular point of the state space 
is indicated by the subscript x. The classical observables 
H c and S c in Eq. ([5]) are the energy and the entropy of 
the environment, respectively. Dissipative brackets are 
commonly used to characterize the entropy production 
rate in nonequilibrium thermodynamics [12l . |22j. They 
are characterized by the following properties: [A c , B c ] is 
bilinear in A c and B e , is symmetric, 

L4 ,B C ] = [B C ,A C ], (9) 

as well as nonnegative, 

L4 C ,A C ]>0, (10) 

and satisfies the Leibniz or product rule, 

[A C B C , C e ] = A C [B C , C c ] + B C [A C , C c ], (11) 

for arbitrary environmental variables A c , B c , and C e . 
As a straightforward generalization of Eq. ([5]), several 
coupling operators Qj can be incorporated easily [1, Q . 

D. Nonlinear ity 

A most striking feature of the thermodynamic quan- 
tum master equation is its nonlinearity in p. In view 
of the definition Q of A p , the second term in Eq. © 



will, in general, be nonlinear in p. This definition can 
be rewritten in a form that brings out the relationship 
to another possible compromise in placing p and extracts 
the nonlinearity, 

A p = ±(Ap + pA + A' p ), (12) 
with the nonlinear term 

A' p = - f [p x ,\p l - x ,A]]d\. (13) 
Jo 

Setting A' p = corresponds to a linearization of the mas- 
ter equation ([8|) which has been proposed, but not rec- 
ommended, in Q. We hence may think of A' p as the 
origin of nonlinearity in the full thermodynamically con- 
sistent quantum master equation. The occurrence of A p 
is a consequence of employing canonical correlations ( ; ) 
(see Eq. (4.1.12) of [20]) as the key structural element in 
the generalization of dissipative brackets from classical 
to quantum systems, 

(A; B) = f tx{p x Ap l - x B)d\ = tx(A p B). (14) 

JQ 

The canonical correlation is symmetric, (A; B) = 
(B;A} p , and positive, (A; A) > 0. Moreover, averages 
can be obtained as special cases of canonical correlations, 
(A) p = tr(Ap) = tr(A p ) = (A; I) p . 

The evaluation of A p involves the calculation of the 
powers p x . To handle the nonlinear quantum master 
equation it is hence natural to determine the eigenstates 
\ir n ) and the eigenvalues p n of the density matrix p and 
to make use of the representation 

P = ^2PnWn) (TTnl- (15) 

n 

In terms of the eigenstates of p, the evaluation of the 
matrix elements of the modified operator A p is straight- 
forward because the integration over A can be carried 
out. We obtain the useful identity 

(ir m \A p \-K n ) = - — - — — (Tr m \A\ir n ) , (16) 
\np m ~ lnp n 

which is equivalent to Eq. ([5]). For the factor occurring 
between the matrix elements of A p and A in Eq. (|16|) . we 
have the inequalities 

q ^ Pm Pn ^ Pin T Pn ^ ^ (17) 

~ lnp m - lnpn ~ 2 

where the central inequality becomes an equality if, and 
only if, p m and p n are equal. If we use the approximation 

Pm Pn Pm T Pn /io\ 

i i n ' 

mp m - mpn 2 
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which corresponds to setting A' — in Eq. (IT21) . we ar- 
rive at the previously mentioned linearized master equa- 
tion 



[H D ,H ]Q[Q,[Q,p]], 



(19) 



where { , } is the anticommutator. 

The linearization obtained by turning the inequality 
(|17p into the approximation (|18l) may look somewhat 
ambiguous. It is clearly different from a systematic lin- 
earization around a given reference state, but with the 
attractive advantages of simplicity and generality. This 
linearization corresponds to replacing A p by (Ap-\-pA)/2, 
which looks like a reasonable alternative to solve the 
problem of placing p in the product of A and p. Whereas 
Eq. (|19[) is a convenient linearization of the thermody- 
namic master equation (|8]), we do not recommend its use 
because it destroys the thermodynamic structure of the 
original master equation. The thermodynamic structure 
is important for the qualitative properties of the solu- 
tions, for example, for the existence of canonical equilib- 
rium solutions, as discussed in the following subsection. 



E. Heat bath 

The thermodynamic approach to quantum dissipation 
is valid for arbitrary environments, as long as they may 
be treated as classical nonequilibrium systems. We here 
consider the simple and important special case of a heat 
bath which can be described by a single independent 
state variable x, say the total energy H c . The com- 
plete thermodynamic information about this system is 
contained in the functional form of the entropy, S C (H C ). 
In particular, we can assign a temperature T c to the heat 
bath, 



1 



ggeCge 

dH 



(20) 



The most general form of a dissipative bracket for a 
heat bath is given by 



[A C ,B C ]' 



dAp . , dB P 
— - M(T e ) — - 
dH c v ' dH c 



(21) 



where M(T e ) is a positive function. Such a bracket is bi- 
linear, symmetric, positive, and satisfies the Leibniz rule, 
as postulated in Eqs. ([9|)-(fTTj). Any dissipative bracket 
for the heat bath at temperature T c hence satisfies the 
additional condition 



T C [H C , S c ]® — [H e ,H e ] 1 



(22) 



which is exactly the condition required to obtain the 
canonical equilibrium solution to the quantum master 



equation ([8]) expected for weak coupling between the 
quantum and classical subsystems, 



oc exp 



H 

knTp 



(23) 



To verify this equilibrium solution, one can make use 
of the identity [A, p] = [A p ,\np], which is implied by 
Eq. ([T^]). in the last term of the master equation © for 
A = Q. The guaranteed existence of the canonical equi- 
librium solution is a convenient advantage of the thermo- 
dynamic quantum master equation. It is deeply linked to 
the nonlinearity of the master equation and hence to the 
formulation of the dissipative bracket in terms of canon- 
ical correlations. 

The general thermodynamic approach also provides an 
equation for the entropy production. The average S of 
the total entropy of the quantum subsystem and its clas- 
sical environment evolves according the equation 



dS ( dp 



dSr, 



dt 



(24) 



For a pure heat bath at temperature T e , by construction 
of the dissipative bracket the entropy production can be 
expressed in terms of the canonical correlation Q 



dS_ 
~dt 



M(T C ) 



■i[Q,F);i[Q,F]) t 



where 



(25) 



(26) 



F = H + k B T c \np 
is the Helmholtz free energy operator. 

F. Reaction on environment 



The master equation (J5|) describes the influence of 
a classical environment on a quantum subsystem. Of 
course, in response, the quantum system also has an in- 
fluence on its environment. In general, the state x of 
the environment hence varies in time and the strength 
of the coupling in the thermodynamic quantum master 
equation ([5]) becomes time-dependent. By neglecting the 
evolution of T e for a heat bath we implicitly assume an 
infinitely large heat capacity of the bath. 

The thermodynamic approach actually provides a cor- 
responding equation for the evolution of environmental 
observables, 



dA c 



dt 



- i-[4,,SJ?<[Q,fl];[Q,H]>, 
+ [A e ,H e ]Q{[Q,[Q,H}]) p . 



(27) 



In this equation, { , } and [ , ] are the Poisson and dissi- 
pative brackets of the classical system, respectively (Tol — 
[l2l ]. In addition to the properties (|9"j)- (fTTj) of dissipative 
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brackets, energy conservation in the environment (except 
for the balanced exchange of energy with the quantum 
subsystem) is guaranteed by the degeneracy requirement 
L4 ,iJ ] = for all classical observables A c . The Pois- 
son bracket { , } is bilinear, antisymmetric, and satisfies 
the Leibniz rule as well as the Jacobi identity, where the 
latter expresses the time-structure invariance of the Pois- 
son bracket [12j, I23l425j . All these properties of classical 
Poisson brackets are shared by their famous quantum 
counterparts, the commutators [l3| . 

If one looks only at the master equation ([5]), the 
occurrence of time-dependent coefficients suggests non- 
Markovian behavior. If one considers the coupled evolu- 
tion of the quantum subsystem and the classical environ- 
ment according to the thermodynamically coupled set of 
Eqs. © and (|2"T|) . however, the Markovian character of 
the description is restored, provided that the total sys- 
tem is closed. By comparing Eqs. and (|2"T)) one notes 
obvious exchange terms between the two subsystems. 

The nonlinear quantum master equation © for the 
special case of a heat bath with dissipative bracket (|2"Tj) 
and constant T c has previously been given in Eq. (5.22) 
of Q. This result for the special case of relaxation to 
equilibrium was derived by means of projection-operator 
techniques. The thermodynamic approach of [9] allows 
us to consider arbitrary thermodynamic systems as envi- 
ronments and provides the fully consistent description of 
the mutual influence of classical environments on quan- 
tum subsystems and vice versa. A simple example of 
a generalization of temperature control by a heat bath 
would be pressure control by the environment. More in- 
teresting generalizations are obtained for anisotropic en- 
vironments or when the environment itself is an open 
system controlled from the outside. The treatment of 
classical open thermodynamic systems within the geo- 
metric approach to no neq uilibrium thermodynamics has 
been developed in [26l - l30l |. 

III. SOLUTION STRATEGIES 

As already elaborated, the quantum master equation 
([5]) is nonlinear in p through the modified operator 
[Q,H] p defined in Eq. (0}. For that reason, it is im- 
portant to diagonalize the density matrix p. Instead of 
carrying out the diagonalization of the density matrix 
in every time step, we propose to write evolution equa- 
tions directly for the eigenvectors \n n ) and the eigenval- 
ues p n in the representation ([T5|) of p, or for the projectors 
n„ = |7r n ) (7r„| which may sometimes be more convenient 
to work with. For simplicity, we assume that all eigen- 
values p n are pairwise different from each other. 

For a master equation of the general form 

^ = i[p,H]+R, (28) 

with a traceless self-adjoint operator R representing the 
irreversible contribution to the time evolution of p, we 



have 

— - = Un n ,H] + — z — (n„i?n m + n m i?n„), 

(29) 

for the projectors and 

^ = (7r n |iZ|7r n ) = tr(n„MI„), (30) 

for the eigenvalues. It is straightforward to verify that 
the separate evolution equations ([29)) and (f30]) imply the 
master equation (f28|) by using the representation (fT5|) of 
the density matrix and the product rule. 

The evolution of the eigenvectors can be expressed as 

~dT = ~h H M + \f n~P^ t km) <7rm| R kn) ' 

(31) 

which reproduces Eq. (|29p. Addition of iX n |7r„) to 
Eq. (|3Tj) . with an arbitrary choice of the real phase shift 
parameters X n , would still be possible. Equation (|3"Tj) 
may be considered as a modification of the Schrodinger 
equation for the eigenstates of the density matrix in the 
presence of dissipation caused by a perturbation from the 
environment. It looks very similar in structure to the re- 
sult of time-independent first-order perturbation theory. 
Note, however, that Eq. (131) describes the rate of change 
of \ir n ) rather than a small perturbation of 1 7r rl ) . 

For the actual solution of the combined Eqs. (|3"0|) and 
(|3ip . it is important to be able to evaluate matrix ele- 
ments of the form (7r m | R \n n ). A comparison of Eqs. (|8]) 
and (f2"5)l shows that R contains products of the form 
Q[Q 7 H] P , [Q,H] P Q, QQ, and QpQ, which can all be 
evaluated after introducing a single partition of unity in 
terms of the eigenstates of the statistical operator. In 
particular, the resulting matrix elements of [Q, H] p can 
then be evaluated by means of Eq. ([T5| . The right-hand 
side of Eq. ([3~Tj) then contains terms of first, third, and 
fifth order in |7r„) and irrational but elementary functions 
of p n . In comparison, solution of the linearized master 
equation (|19[) is considerably simpler because there is no 
need to diagonalize the density matrix p. 

IV. EXAMPLE: TWO-LEVEL SYSTEM 

As our first example, we consider the two-level sys- 
tem. In spite of its simplicity, the two-level system has 
successfully been used to describe both nuclear magnetic 
resonance and spontaneous emission in quantum optics 

a 

A. Notation 

For a fc-state (or, fc-level) system, the underlying 
Hilbert space is a fc-dimensional complex vector space 
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which, without loss of generality, we can take as C fe . 
The space of observables is the fc 2 -dimensional real vector 
space of self-adjoint k x /c-matrices with complex entries. 
For the two-level system, we choose the 2 x 2-unit matrix 
/ and the three Pauli matrices 



















i 


, CT 2 = 




, °3 = 
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y (32) 

as the base vectors of the space of observables. More 
precisely, we express every self-adjoint complex 2x2- 
matrix A in terms of a real scalar a and a real three- 
vector a — (01,02,03), 

A = 0(a, a) = - (cd + a\ax + a 2 er2 + 030-3) . (33) 

Note that a is the trace of A. Commutators and anti- 
commutators can then conveniently be expressed as 



and 



[A,B] = iO(0,ax b), 



{A, B} = 0(a/3 + a-b,/3a + ab). 



(34) 



(35) 



From Eq. (|34[) . we obtain an identity for the frequently 
occurring double commutators, 



[A, [A, B]] -0(0, [a 2 l-aa] -6), 

where a — \a\ and 1 is the 3 x 3- unit matrix. 
Eq. (|35|) . we obtain 

2tr(AB) =af3 + a-b. 



(36) 
From 

(37) 



Arbitrary functions / of an observable A can be calcu- 
lated with the formula 



f(A) = (/+ + /_, [/+-/_] a/a), 



with 



/+ = / 



/- = / 



(38) 



(39) 



Equation (|38j) can be verified by induction for arbitrary 
powers of A and then be generalized by Taylor expansion. 
From Eq. ([38]) we further conclude that (a + a)/2 and 
(a — a)/2 must be the eigenvalues of A. 

As the density matrix has trace unity, it can be written 

as 



P = 0(l,m) 



(40) 



For the eigenvalues to be nonnegative, we need m = 
|m| < 1. This set of admissible choices of m is known as 
the Bloch sphere. For m = 1, one of the two eigenvalues 
of p is zero and we have a pure state. From Eq. (|37[) . we 
obtain (A) = (a + a ■ m)/2, which implies that the jth 
component of m is given by the average {<Jj) ■ 




FIG. 2: The function /x(m) characterizing the nonlinear con- 
tribution to the thermodynamic quantum master equation for 
a two- level system [see Eq. (|42[) ]. 



By using Eqs. (J34J) and fl38J) in Eq. ([13]), we find the 
following explicit form for the nonlinear part of A p , 



A' 



-/i(m)o(o,[ 



m 2 1 



mm • a 



with 



1 



1 artanh 1 



(41) 



(42) 



The function pirn) is displayed in Figure [2] The singu- 
larities of the two terms in Eq. (|42[) at m = cancel so 
that fj,(m) ~ 1/3 for small m. According to Eq. ([36]) . the 
factor [m 2 1 — mm] may be regarded as a double commu- 
tator formed with p. The nonlinear contribution to the 
quantum master equation associated with /i(m) leads to 
an improved relaxation behavior, as we shall see below. 



B. Bloch equation 

To arrive at an evolution equation, we now choose the 
Hamiltonian H = 0(0, hbjq^), where w is the angular fre- 
quency associated with the energy difference between the 
two levels of the system and 93 = (0, 0, 1), as well as the 
two coupling operators Qj — O(0, qj) with qi = (1,0,0) 
and q2 = (0, 1, 0) (note that we actually make use of the 
generalization mentioned at the end of Sec. Ill C[) . The 
environment be a heat bath, the state of which be charac- 
terized by its energy H c . According to Eq. (|20[) . the tem- 
perature T e is implied by the thermodynamic relationship 
S C (H C ). This temperature characterizes the black-body 
radiation to which our system is exposed. Both dissipa- 
tive brackets are assumed to be of the form (|2"T1). 



, dA c k B T c dB e 

[A e ,B e y = 7o 



dH, 



huj dH P 



(43) 



where 70 is the spontaneous emission rate. 

The quantum master equation ([5]) can now be recog- 
nized to be equivalent to an evolution equation for m, 
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known as the Bloch equation |32j |. 

dm 2k B T c _ 

oj q3 x m — 70 — R ■ m 



df 



I 1 1 



7o93+7o|(^ 2 l + "T-"T-)-93, (44) 



with 



R= -(1 + 9393)- 



(45) 



Our choice of the coupling operators Qj is motivated 
by the two Lindblad operators that have been derived 
for quantum optical applications of two-level systems 
for the case of spontaneous emission (see, for example, 
Eq. (3.219) of 1]). As an alternative, one could include 
Qs = 0(0, qz) as a third operator with the same dissi- 
pative bracket (l4"3")l to achieve an isotropic frictional cou- 
pling. The only effect would be to change the anisotropic 
matrix R in Eq. (|45[) into the unit matrix 1. This would 
correspond to the case of strong collisions that cause en- 
ergy decay whenever they cause dipole phase interrup- 
tion [33| . For nuclear spin relaxation, for which the Bloch 
equation had originally been proposed, the situation with 
R = 1 can also be realized, namely in isotropic molecular 
environments, both in gases and in low- viscosity liquids 
[34j . It is well known, however, that longitudinal relax- 
ation rates that are by orders of magnitude smaller than 
the transverse ones are much more typical for nuclear 
spin relaxation [32]. This situation can be achieved by 
enhancing the coupling strength associated with 93 to 
become the dominating one. 

The equilibrium solution of Eq. (|44|) is given by 



m, 



eq 



-<73 tanh 



2k B T c 



(46) 



which is consistent with the canonical equilibrium distri- 
bution (I23p . The occurrence of tanh in the equilibrium 
solution (14T>1) is a direct consequence of the occurrence of 
artanh in Eq. (|42|) . Contrary to the steady solution of the 
linear quantum master equation obtained from Eq. (|44[) 
for \i = 0, 



dm 
~~dt 



2k B T e 

= wq 3 x m-7o— r R m-~/ q 3l (47) 



which is given by m cq = —q^huj/(2k B T c ), the steady 
state (|46|) always lies in the Bloch sphere, even for very 
low temperatures. The time-dependent solution of the 
thermodynamic quantum master equation can actually 
never leave the Bloch sphere, which is a nice consequence 
of thermodynamic consistency. Note that, for very low 
temperatures, the solution of the linear master equation 
(H7)l must leave the Bloch sphere because m cq > 1. This 
problem can be circumvented by the simple replacement 



2k B T c 



tanh 



\2k B T c 



(48) 



in Eq. (|47|) . With this replacement, one recovers the equi- 
librium result (|46p and actually obtains the well-known 
master equation of the Lindblad form (see Eqs. (3.224)- 
(3.228) of (3). 

For a small deviation m' from the steady state solution 
(|4"6"|) . we obtain the following result by straightforward 
linearization of Eq. (|44"]) . 



dm' 

dt 



to Q3 x m 



2k B T e , 
7o— r R ■ m 



m cq /i , 2 dfi 

"7o^— (1 + 3q 3 g3) • m - 7o™- oq — ■ 



(49) 



where fi(m) and its derivative are to be evaluated at 
m oq . The nonlinear terms enhance the relaxation in an 
anisotropic manner, most dramatically near the bound- 
ary of the Bloch sphere. This result of a systematic lin- 
earization of the thermodynamic master equation around 
the steady state is significantly different from the predic- 
tion of the usual linear Bloch equation (T4"7| with the re- 
placement (|48p . The predicted strong dependence of the 
relaxation behavior on the location of the steady state 
within the Bloch sphere could be tested experimentally. 



V. EXAMPLE: DAMPED HARMONIC 
OSCILLATOR 

For a detailed comparison of the linearized quantum 
master equation (|19p with the nonlinear thermodynamic 
master equation ([5]) , we study the example of the damped 
harmonic oscillator in one dimension. We consider the 
motion of a particle of mass m in the potential V(Q) = 
muj 2 Q 2 /2, where ui is the angular frequency of the un- 
damped harmonic oscillator. The position and momen- 
tum are given by Q and P with the canonical commuta- 
tion relation [Q, P) — ih, which leads us to 



[Q,H] 



ih . 



-p. 



(50) 



for H = P 2 /{2m) + V(Q). 

For the dissipative coupling of the oscillating particle 
to a heat bath, we use the position Q as the coupling op- 
erator in Eq. ([8]) because friction should explicitly affect 
only the momentum P of the particle, not the position 
Q. As it is convenient to characterize friction on a par- 
ticle in terms of the friction coefficient £, we rewrite the 
dissipative bracket in Eq. (|2"TT) as 



[A e ,B e f = 



dA c (^k B T c 



dH v h 2 



dB c 
dH Q 



(51) 



It should be noted that the coupling of a harmonic 
oscillator to a heat bath is not unique. We here have 
chosen a coupling for which dissipation directly affects P 
only. This corresponds to our intuition for the motion of 
a particle in a potential. However, one could alternatively 
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assume a symmetric coupling in which both Q and P are 
explicitly affected by dissipation. This has actually been 
done in Eq. (3.307) of Q. Such an assumption is natural, 
for example, for a harmonic oscillator representing an 
electromagnetic field mode inside a cavity. 



where the decay rate Q/m in the exponential also reduces 
the angular frequency of the harmonic oscillator. Results 
for other second moments could be obtained just as eas- 
ily. Equation (|55p contains our reference result for the 
damped harmonic oscillator in the usual linear descrip- 
tion. 



A. Caldeira-Leggett master equation 



After inserting Eqs. ([50)) and ([5"Tj) into the linear quan- 
tum master equation (|19p for a particle moving in a po- 
tential and damped by friction with a heat bath is of the 
form 



dp 



:\p,H]- 



h 2m 



[Q,{P,p]]- 



(k B T c 

h 2 



[Q,[Q,P\]- (52) 



This equation is known as the Caldeira-Leggett master 
equation (see, for example, Equation (3.410) of pj). It 
is actually valid for an arbitrary potential V(Q); the 
assumption of a harmonic potential is needed only for 
the next step. The Caldeira-Leggett equation cannot be 
brought into Lindblad form (see p. 178 of [l|). 

From second moment equations (3.428)-(3.430) of [l[, 
which follow from the Caldeira-Leggett master equation 
(|52[). we obtain the following closed linear differential 
equation for the second moment of P for a harmonic 
oscillator, 



dt 3 m dt 2 





I. 






dt 


m 



(P 2 ) = 



4 W 2 fc B T e C. (53) 



If, for the initial state, the eigenvectors of the density ma- 
trix coincide with those of the Hamiltonian (for example, 
if we start from an equilibrium ensemble or an energy 
eigenstate) , then the initial conditions for the differential 
equation can be expressed as 

(P 2 ) = <A>. 



d(P 2 ) 
dt 
d 2 (P 2 ) 
dt 2 



mk B T. 



m 

►2 



(54) 



The explicit solution of the linear differential equation 
(|53p with the initial conditions (|54p is given by 



(P 2 ) t = mk B T c 



(P 2 ) Q - mk B T c 
4u 2 -( 2 /m 2 



-<t/r 




(55) 



The average (P 2 ) changes exponentially with superim- 
posed oscillations from the initial level to the final one, 



B. Thermodynamic quantum master equation 

The thermodynamic quantum master equation for the 
damped harmonic oscillator is obtained by inserting 
Eqs. (|50p and (1511) into the quantum master equation 
USD to obtain 



dO i r , i C r„ 

-f = ^H]--^-[Q,P p ] 
dt n nm 



(k B T c 

h 2 



[Q,[Q,P\]- (56) 



In contrast to the Caldeira-Leggett master equation (|52[) , 
the thermodynamic master equation is seriously nonlin- 
ear in p, even for the harmonic oscillator. For a detailed 
comparison, we hence need numerical solutions for con- 
crete situations. 

We consider the evolution that takes place if we start 
with a system equilibrized at k B Tg = (3/2)Hu) and, at 
t = 0, quench the bath temperature to k B T c = (l/2)7kj. 
These initial and final values of the temperature in en- 
ergy units correspond to the first excited and ground 
state energies of the harmonic oscillator, respectively. 
Of course, these low temperatures have been chosen to 
see pronounced quantum effects. During relaxation, the 
probability of the ground state increases from 0.49 to 
0.86. According to p}, the validity of the quantum mas- 
ter equation for such low temperatures can be established 
if the friction coefficient is sufficiently small. We here as- 
sume C/m = w/10 to be on the safe side. 

For the representation of all operators and the time- 
dependent eigenstates \ir n ) of the density matrix, we use a 
finite number of energy eigenstates |n), n = 0, . . . N. The 
Hamiltonian is then represented by the diagonal matrix 



H = fvjj 



\ 




(57) 



\0 N+y 



which is exact on the truncated space. For the truncated 
position operator Q, we use the following matrix repre- 
sentation with nonzero entries only next to the diagonal, 



Q = 



2muj 



( 1 

1 \[2 

V2 V3 

V3 

\o o Vn / 



\ 







(58) 



which is obtained after simply omitting the couplings of 
the state \N) to \N + l). The operators Q 2 and [Q,H] 
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FIG. 3: Relaxation of the average square of momentum after 
quenching a harmonic oscillator to a very low temperature 
for the linear (thin lines) and nonlinear (thick lines) quantum 
master equations. The horizontal dashed lines indicate the 
corresponding asymptotic values. Only the nonlinear equa- 
tion leads to the correct equilibrium value (thick dashed line). 



are evaluated in the truncated space. For example, one 
obtains from Eqs. ([57)1 and (I5T 



\ 








[Q,H} = 



2m 



/ 1 

-1 V2 

-V2 %/3 

-\/3 



V o 







o o -Vn o / 



Equation (|50[) can then be used to introduce the momen- 
tum operator P on the truncated space in terms of this 
expression for [Q,H], and also P 2 is evaluated in the 
finitc-dimcnsional Hilbert space. 

We first implemented both the direct solution of the 
linear Caldeira-Leggett master equation (|5Hj) for p and 
the solution of the corresponding Eqs. (|50"|) and (piTj) for 
the eigenvalues and eigenvectors of p in Mathematica ® 
(Version 7.0.1.0). As the direct solution for the linear 
case does not require any diagonalization, its implemen- 
tation is significantly simpler and more efficient com- 
pared to solving the equations for the eigensystem given 
in Sec. Mil Both implementations give identical results. 
It turns out that 10 states (N = 9) are sufficient to re- 
produce the exact results and this value is hence used 
for all calculations presented here. More precisely, for 10 
states, the truncation error in the initial value of (P 2 ) is 
1%, which is the largest error overall because the energy 
and hence the importance of the higher states decreases 
with time. 

The evolution of (P 2 ) and its asymptotic value are rep- 
resented by the thin lines in Fig. [3] The asymptotic value 
of (P 2 ) for the linear Caldeira-Leggett master equation 
is given by mk^T e , as can be seen most easily from the 




0.998 



0.997 
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cot 



FIG. 4: Overlap of the first few eigenstates of the Hamil- 
tonian (with lowest energies) and the density matrix (with 
largest probabilities) after quenching a harmonic oscillator to 
a very low temperature as a function of time. From top to 
bottom, the lines correspond to the states with j = 0, 1, and 
2, respectively. 



explicit solution (|55|) (which is represented by the thin 
continuous line in Fig. [3]). This value differs from the 
exact value 



(P 2 ) = -humcoth ( — 
X 1 2 \2k B T e 



(60) 



for a harmonic oscillator in an equilibrium state at tem- 
perature T e , which is indicated by the thick dashed line in 
Fig. El The linearized master equation does not converge 
to the proper equilibrium solution at low temperatures. 

For solving the nonlinear thermodynamic master equa- 
tion ([56"]) . we us the less efficient algorithm based on the 
corresponding Eqs. (1301) and (13T1) for the eigenvalues and 
eigenvectors of p. As only a few eigenstates are involved 
when we focus on low temperatures to see the nonlin- 
ear quantum effects, efficiency is is not really an issue 
(all calculations together took less than two minutes on 
a standard desktop computer). The big advantage of 
the algorithm based on eigensystems is that the passage 
from the linear to the nonlinear master equation requires 
a change in a single line of code only, namely the replace- 
ment described by the approximation ([18]). 

The result for the evolution of (P 2 ) obtained from the 
thermodynamic quantum master equation is indicated 
by the thick continuous line in Fig. [3j The solution con- 
verges to the correct limit (|5CT|) and the asymptotic value 
is approached faster than for the linearized equation. 

The eigenstates of the initial and final equilibrium den- 
sity matrices coincide with the energy eigenstates. In or- 
der to detect intermediate deviations from an equilibrium 
state with time-dependent temperature, we consider the 
matrix elements (j |tTj-) characterizing the overlap be- 
tween corresponding eigenstates of the Hamiltonian and 
the density matrix. The results for j = 0, 1, and 2, that 
is, for the states with the lowest energies and the high- 
est probabilities, are shown in Fig. 01 The overlap turns 
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out to be very close to unity at all intermediate times, in 
particular for the ground state. This is a consequence of 
the small value of the friction coefficient. Doubling the 
friction coefficient enhances the largest deviation from 
unity by a factor of four. For small friction, the system 
approximately evolves through a sequence of equilibrium 
states with time-dependent temperature and can hence 
be fully characterized by the decay of the energy, which 
is almost purely exponential. Note, however, that the 
small deviations of the overlap from unity in Fig. 2] are 
important as they cause the oscillations of the average 
(P 2 ) in Fig.O 



VI. SUMMARY AND CONCLUSIONS 

Nonlinearity is the most striking feature of the ther- 
modynamic quantum master equation. This is a funda- 
mental difference compared to the linear Liouville and 
Schrodinger equations describing reversible classical and 
quantum systems, and also to the Fokker-Planck equa- 
tions for irreversible classical systems. It is the combi- 
nation of irreversible thermodynamics and quantum me- 
chanics that causes the nonlinearity. Even the master 
equation for the harmonic oscillator is seriously nonlin- 
ear. This fundamental nonlinearity is missed in the pop- 
ular Caldeira-Leggett and Lindblad-type master equa- 
tions. Just like for the linear Lindblad equations, the 
solutions of thermodynamic master equations stay in the 
physical domain for all times, which is known to be a sub- 
tle issue for nonlinear equations 



For the two-level 
system, the present work shows that the nonlinearity can 
be handled very elegantly. In general, however, the non- 
linearity necessitates numerical investigations. 

We have shown how the damped harmonic oscillator 
can be handled numerically. A coupled set of equations 
for the eigenvalues and eigenvectors of the density matrix 
is appealing because the nonlinearity can then be treated 
in a simple way. As the nonlinearity is a pure quantum 
effect, its consequences are felt only at low temperatures 
where only a few states are involved so that practical cal- 
culations remain feasible. Our results for the relaxation 
of a harmonic oscillator after a quench to a very low tem- 
perature show that the solution behavior is improved by 
the nonlinearity. In particular, the canonical equilibrium 
density matrix is approached when the nonlinearity is 
taken into account. 

The thermodynamic quantum master equation ([5]) de- 
scribes the influence of any classical environment on a 
quantum subsystem under the assumption of weak cou- 
pling. Moreover, it is supplemented by Eq. (|27]l describ- 
ing the reverse influence of the quantum subsystem on 
the environment. If the total system is closed, we obtain 
a Markovian description of the coupled subsystems even 
if the coefficients in the quantum master equation change 
with a changing environment. 

As quantum master equations are nowadays employed 
in many applications involving dissipative quantum sys- 



tems, the nonlinear thermodynamic quantum master 
equation offers a new perspective on many problems. 
Problems that involve more complicated environments 
than simple heat baths can be approached in a thermo- 
dynamically consistent way. It is even possible to study 
situations in which the classical environment itself is an 
open system controlled from the outside. The treatment 
of classical open thermodynamic systems within the geo- 
metric approach to nonequilibrium thermodynamics has 
been developed in |26l - [30| . If the quantum nature of 
the environment plays a role, one might want to con- 
sider three subsystems: the quantum system of interest, 
a quantum environment, and the classical environment. 
A coupling of either quantum system, or both quantum 
systems, to the classical environment would be possible. 

One might ask why the thermodynamic master equa- 
tion for a quantum system coupled to a heat bath pro- 
posed in [J] has not been used more frequently dur- 
ing the past three decades. Maybe concerns about the 
tractability of this seriously nonlinear equation have lim- 
ited its impact. The examples of the present paper should 
demonstrate that simple low-temperature applications 
can be handled quite efficiently. More complicated prob- 
lems can readily be solved b y w ell-established stochastic 
simulation techniques 0, l36l - l39j | for which the nonlinear- 
ity of the thermodynamic master equation does not cause 
any serious difficulties [ioj . 

The nonlinearity of the thermodynamic master equa- 
tion for dissipative quantum systems has a number of 
important conceptual implications. First, as has been 
pointed out in the introduction and discussed in Sec. Ill Bl 
the usual "quantum regression hypothesis" becomes in- 
valid and needs to be modified Second, it is no 
longer possible to pass from the Schrodinger picture to 
the Heisenberg picture because, both for reversible quan- 
tum mechanics and for linear quantum master equations, 
this change of pictures relies on the formal solution of the 
linear evolution equations in terms of exponentials (see, 
for example, Sec. 3.2.3 of [l[). For dissipative quantum 
systems, the Schrodinger picture appears to be more fun- 
damental than the Heisenberg picture. Third, as a direct 
consequence of the absence of a Heisenberg picture, the 
usual procedure for introducing two- or multi-time corre- 
lation functions fails (see, for example, Sec. 3.2.4 of [l[). 
The quantum master equation describes the time evolu- 
tion of the density matrix and hence also the evolution 
of all averages of observables for a given initial density 
matrix, but no two- or multi-time correlations. A natural 
possibility to define multi-time correlations would be to 
incorporate a given (positive) observable A at a certain 
time into the density matrix p by switching to the condi- 
tional density matrix A p and to continue the evolution of 
the master equation with A p instead of p. This process 
can be iterated several times. If the nonlinear master 
equation is linearized around equilibrium, the proposed 
procedure has actually been established to be correct for 
two-time correlations 

One of the most fascinating applications of the ther- 
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modynamic master equation, which crucially relies on its 
validity in the limit of low temperatures and small dissi- 
pation rates, is in quantum field theory [4l|. A friction 
mechanism can be used to smoothen quantum fields on 
short length scales by well-structured dynamic equations 
with well-behaved solutions. The physical origin of irre- 
versibility in quantum field theory lies in the field ide- 
alization which requires renormalization and hence the 
elimination of degrees of freedom and the loss of com- 
plete control. The thermodynamic approach solves many 
problems of the usual renormalization program in quan- 



tum field theory which are caused by a fixed cutoff proce- 
dure that spoils the structure of the underlying reversible 
equations in an uncontrolled manner [41| . 
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